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ARTIFICIAL NEURAL NETWORK FOR PREDICTING RESPIRATORY 
DISTURBANCES AND METHOD FOR DEVELOPING THE SAME 



5 



10 1. - Field of the Invention 

The present invention relates to an artificial 
neural network ("ANN") for predicting respiratory 
disturbances, and a to method for developing such an 
("ANN") . 

15 

2. Background Art 

Regression models have been used to produce 
prediction rules for predicting whether an individual 
. has a particular attribute, such as a sleeping disorder. 

20 Such regression models often use physical features and 
clinical traits indicative of a high probability of the 
attribute. However, the predictive rules produced by 
such regression models often lack specificity, and offer 
only a dichotomous output based on a predetermined 

25 cutoff value, particularly with respect to the 

apnea /hypopnea index ("AHI") , which is an index related 
to obstructive sleep apnea ("OSA") . Furthermore, to 
compound the deficiencies of such prediction rules, the 
predetermined cutoff value associated with a particular 

30 model is often selected arbitrarily, and furthermore, 
varies from model to model. Moreover, the statistical 
methods used to derive these models may not fully take 
into account nonlinear attributes of complex processes. 
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OSA has been recognized increasingly as an 
important public health problem with potentially serious 
cardiovascular and psychomotor morbidity, and possibly 
excessive mortality. An increased awareness of the 
5 risks associated with OSA in recent years has led to an 
increase in the number of referrals to specialists and 
sleep laboratories. Overnight polysomnography TOPG") 
is the standard reference test for diagnosing OSA. 
However, OPG is an expensive, labor-intensive, and time 
10 consuming procedure. As a result, there is a need for a 
practical and less work-intensive screening test to 
allow physicians to estimate whether patients have OSA. 

15 

SUMMARY OF THE INVENTION 

The present invention provides an ANN for 
predicting respiratory disturbances, and a method for 
developing an ANN. 
20 An object of the present invention is to provide a 

method of developing an ANN which results in a 
prediction having more specificity and having fewer 
dichotomous outputs than prior art 

prediction rules developed through regression analysis 
25 models. 

t- r 

Furthermore, it is an object of the present 
invention to take into account nonlinear relationships 
and intricate interrelationships among attributes of 
complex processes, such as a biological system. 
30 Another object of the present invention is to 

provide a screening test for predicting OSA which is 
less expensive to use, less labor-intensive to use, and 
less time consuming to use than OPG. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 shows the steps of the ANN according to 
the present invention; 

Figure 2 shows the steps of the method for 
5 developing an ANN according to the present invention; 

Figure 3 shows demographics of a validation data 
set described herein; 

Figure 4 is a comparison between patients who 
participated in a sleep study described herein; 
10 Figure 5 is a list of questions and statements, used 

- to develop .the ANN of the present invention; 

Figure 6 is a -graph showing receiver operator 
characteristic curves used to develop and analyze the 
ANN of the present invention; 
15 Figure 7 is another graph showing receiver operator 

characteristic curves used to develop and analyze the 
ANN of the present invention; and 

Figure 8 shows the relation between the predicted 
and actual AHI for patients in the validation data. set 
20 together with the point wise 95% confidence limits. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The present invention includes a method, referred 
to herein generally as an ANN, that can predict the AHI 

25 of patients suspected of OSA. The ANN of the present 

invention uses a combination of anthropomorphic data and 
clinical information obtained from a patient to predict 
the AHI of that patient. The AHI is indicative of the 
likelihood that an individual has OSA. Fig. 1 shows the 

30 method steps of the present invention. The present 

invention is also directed at a storage device, such as 
a floppy disk, having stored thereon computer readable 
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code for causing a computer to execute all or a 
substantial portion of the ANN. 

Furthermore, the present invention includes a 
method for developing an ANN, such as the ANN described 
5 herein. Fig. 2 shows the method steps of this aspect of 
the present invention. An ANN is a numerical processor 
that accepts multiple pieces of information, usually in 
digital form, performs calculations using the pieces of 
information, and produces results which state whether an 

10 attribute is likely to be present. In an embodiment of 
the present invention, described below in more detail, 
the pieces of information gathered as part of the method 
are answers given by a patient in response to certain 
questions and statements, and the result produced by the 

15 ANN is a predicted AHI. 

In an embodiment of the present invention, the 
method begins (step 10) by gathering information in the 
form of answers and responses to questions and 
statements. In the present invention, the information 

20 includes answers given by the patient to the following 
questions: (a) How old are you (in years)?, (b) How 
tall are you (in meters)?, (c) How much do you weigh (in 
kilograms)?, (d) What is your neck circumference (in 
centimeters)?, (e) Have you been told or been treated 

25 for high blood pressure? (if yes, enter "1", and if no, 
enter "0") . The information gathered (step 10) from the 
patient also includes the responses given by the patient 
to a set of statements. For ease in gathering the 
information, the patient is permitted to give one of 

30 five possible responses for each statement in the set of 
statements. Furthermore, each possible response is 
associated with a number (step 12) . The number is 
determined and used in subsequent steps of the method 
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according to the present invention in lieu of the 
response itself* In an embodiment of the present 
invention, the possible responses to each statement in 
the set of statements, and the number associated with 
5 each possible response are as follows: a response of 
"0.5" means not sure, do not know or is not applicable, 
a response of "0" means strongly disagree or never, a 
response of "0.25" means disagree or rarely has 
occurred, but less than once per week, a response of 

10 "0.5" means somewhat agree or sometimes i.e. 1 to 2 
times per week, a response of "0.75" means agree or 
frequently i.e. 3 to 4 times per week, and finally, a 
response of "1.0" means strongly agree or always or 
almost always i.e. 5 to 7 time per week. The set of 

15 statements includes the following: (a) I am very sleepy 
during the daytime and struggle to stay awake, (b) At 
night, my sleep disturbs my bed partner's sleep, (c) I 
am told I snore in my sleep, (d) I am told I stop 
breathing in my sleep, (e) I suddenly wake up gasping 

20 for breath during the night, (f) I feel tired upon 

awakening and want to go back to sleep, (g) I have or 
have been told that I have restless legs, (h) My desire 
or interest in sex is less than it used to be. 

In Appendix A, incorporated herein by reference, 

25 there is shown the source code for a computer program 

called " sleep. prg" which will cause a computer to prompt 
the user of such a computer for responses to the 
questions and statements discussed above. A computer 
having sleep. prg running thereon expedites the step of 

30 gathering (step 10) the answers and responses from the 
patient. Sleep. prg is shown in Appendix A written in 
Clipper, but other computer languages can be used to 
gather the answers to the questions and responses to the 
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statements discussed above. As shown in Appendix A f 
sleep. prg accepts measurements in the English or metric 
system, and may convert entries to a different 
measurement system. In addition, sleep. prg accepts 
5 responses to each statement in the set of statements in 
the form of a number 1 through 5, but then converts each 
response entered by the user into a number 0 through 1, 
as discussed above. Finally, sleep. prg puts the answers 
and responses in a string so that such information can 

10 be quickly accepted and processed by means for executing 
subsequent steps of the method, discussed below. 

Appendix B, incorporated herein by reference, is 
the source code for a computer program called 
"sleepnet . f or" which executes subsequent steps of the 

15 ANN according to the present invention. Sleepnet.for is 
shown in Appendix B written in Fortran, but other 
computer languages can be used to cause a computer to 
execute the steps according to the ANN. As shown in 
Appendix B, sleepnet.for is written to accept the 

20 answers and responses discussed above in the format 
produced by sleep. prg. 

For ease of reference, X(l) through X(13) will be 
used herein to indicate the numerical values associated 
with the answers and responses (described above) given 

25 by a patient. X(l) relates to the patient's age, X(2) 
relates to the patient's height, X(3) relates to the 
patient's neck circumference, and X(4) relates to the 
patient's blood pressure, and X(5) relates to whether 
the patient is sleepy during the daytime. X(6) relates 

30 to whether the patient disturbs the bed partner, X(7) 
relates to whether the patient snores, X(8) relates to 
whether the patient stops breathing while sleeping, and 
X(9) relates to whether the patient suddenly wakes up 
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gasping for breath. X(10) relates to whether the 
patient is tired upon awakening, X(ll) relates to 
whether the patient has restless legs, X(12) relates to 
the patient's desire to have sex, and X(13) relates to 
5 the patient's weight. 

In the next step 14 of the ANN according to the 
present invention, a BMI value is determined. The BMI 
value is determined by dividing X(13) by the square of 
X(2). In a subsequent step 16 of the ANN, twelve 

10 revised input values., herein referred to as RINP(l) 
through RINP(12), are determined as indicated in 
Appendix B from the numerical values X(l) through X(13). 
RINP(l) relates to age, RINP(2) relates to the BMI 
calculated, RINP (3) relates to neck circumference, 

15 . RINP(4) relates to blood pressure, RINP (5) relates to 
being sleepy during the daytime. RINP (6) relates to 
disturbing the bed partner, RINP (7) relates to snoring, 
RINP (8) relates to stopping breathing while sleeping, 
and RINP (9) relates to suddenly waking up gasping for 

20 breath. RINP (10) relates to being tired upon awakening, 
RINP (11) relates to restless legs, and RINP (12) relates 
to desire to have sex. 

In the next step 18, a first set of predictive 
indicators, the components of which are referred to 

25 herein as "feat2", is determined. Feat2 includes 

twenty-one (21) predictive indicators shown in Appendix 
B as feat2(l) through feat2(21), and are determined as 
shown in Appendix B from the revised input values 
RINP(l) through RINP(12). In a next step 20, a second 

30 set of predictive indicators, the components of which 

are referred to herein as "feat3", is determined. Feat3 
includes twenty-one (21) predictive indicators shown in 
Appendix B as feat3(l) through feat3(21), and are 
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determined as shown in Appendix B from the revised input 
values RINP(l) through RINP(12). 

In the next step 22 of the ANN according to the 
present invention, RINP(l) through RINP(12) are combined 
5 with the first and second sets of predictive indicators 
as shown in Appendix B to produce a first predictive 
number , labeled "output " in Appendix B. As shown in 
Appendix B, the first predictive number ("output") is a 
number between 10 and -10. The calculations shown in 

10 Appendix B may be adjusted to provide for AHI thresholds 
different from 10 per hour, and the present invention is 
not limited to the- first predictive number ("output") 
being between 10 and -10. In the next step 24 of the 
method, a second predictive number, labeled "al" in 

15 Appendix B, is determined as shown in Appendix B. The 

second predictive number, al, once manipulated according 
to Appendix B, is the predicted AHI and in the final 
step 26, is provided to a health professional, such as a 
physician. 

20 The present invention also includes a method for 

developing an ANN, such as the ANN described above. The 
method for developing an ANN is described by way of the 
example which follows and in Fig. 2. Furthermore, the 
ANN described above is further described and explained 

25 by the example which follows. 

In a first step 50 of the method for developing an 
ANN, relevant information which is needed to make the 
desired prediction is determined. In a next step 52 of 
the method for developing an ANN, clinical studies are 

30 performed to determine which patients have a particular 
attribute. As an example of this step 52, patients were 
referred to the Sleep Center at Buffalo General Hospital 
between November 1995 and August 1996 and were 



WO 99/45452 PCT/US99/04808 



- 9 - 



identified retrospectively from the sleep registration 
records and represented the derivation cohort. The 
majority of patients were referred by internists (54%), 
internal medicine subspecialists (36%), or ear, nose and 
5 throat surgeons (7%) . In this example, sleep studies 
(OPG) were performed on two hundred ninety three 
patients during this period. Patients were excluded if 
they had been previously treated for sleep apnea, 
referred for. a specific sleep disorder other than sleep 

10 apnea, or they failed to complete the sleep study. 

In the next step 54 of the method, patients give 
answers to questions and respond to statements and these 
answers and statements are gathered for further 
analysis. In the present example a questionnaire 

15 related to sleep symptoms and motor functions was filled 
out by all .patients prior to undergoing OPG. 
Demographic information (age, gender) and 
anthropomorphic measurements (neck circumference, 
height, and weight) were obtained on each patient. 

20 The questionnaire administered to each patient 

sought answers and responses about a range of clinical 
variables thought to contribute or raise suspicion of 
sleep apnea. Nineteen (19) questions were subjected to 
detailed analysis. The questions had a six-item Likert 

25 response with the following options: never (or strongly 
disagree), rarely (or disagree) , sometimes (or somewhat 
agree) , frequently (somewhat agree) , always (strongly 
agree) , and not sure (or not applicable) . In addition, 
the presence of hypertension and the amount of alcohol 

30 ingestion were determined by patient's self report. 

OPG was conducted on all patients enrolled in the 
study at the Sleep Center. Continuous 
electroencephalogram, elect roculogram, 
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electrocardiogram, and submental electromyogram were 
recorded. Airflow was assessed with an oral and nasal 
thermistor (Graphic Control; Buffalo, NY) , and arterial 
oxyhemoglobin saturation was measured with a pulse 
5 oximeter with the probe placed on the patient's finger 
(Biox IIA or 3700, Ohmeda; Louisville, CO) . Abdominal 
wall and rib cage motions were recorded with an 
inductive plethysmograph (Respitrace Corporation; 
Ardsley, NY) . AH data were recorded on a 16-chanriel 

10 polygraph and digitized on a computerized system 
(Aekitron Medical; Minneapolis, MN) . 

Sleep stages were scored in 30-sec epochs using the 
Rechtschaf f en and Kales sleep scoring criteria. Each 
epoch was analyzed for the number of apneas, hypopneas, 

15 arousals, oxyhemoglobin desaturation, and disturbances 
in cardiac rate and rhythm. Apnea was defined as a 
reduction in airflow of >80% at the nose and the mouth 
for at least 10 sec. Hypopnea was defined as a 50% 
reduction in oronasal airflow associated with either a 

20 4% or greater decrease in oxygen saturation, or an 

arousal; Arousal was defined according to the recent 
AS DA position paper (ASDA Report, EEG arousals: scoring 
rules and examples, Sleep 1992; 15:173-5). The record 
was scored manually by a polysomnography technician and 

25 reviewed by a physician certified in sleep medicine. 
The number of apneas and hypopneas per hour of total 
sleep time was derived, and reported as the 
apnea-hypopnea index (AHI) . A positive sleep study for 
sleep apnea was defined as a AHI>10/hour, other 

30 thresholds were also considered .(>15 or >20/hour) to 

determine the effect of altering the definition on the 
diagnostic accuracy of the predictive models. 
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In the next step 56 of the method , the answers and 
responses are statistically analyzed to determine 
relationships between the answers and responses and the 
results of the clinical studies for the patients. In 
5 the present example, descriptive statistics for 
continuous variables were expressed as mean ±1 SD 
(standard deviation) . Difference in mean values was 
assessed using Student's t test. All tests were two 
tailed and statistical significance was set at a p value 

10 of less than 0.05. Commercially available software were 
used for the multiple linear regression and regression 
tree (S-Plus, Statsci, Seattle, WA) , artificial neural 
networks (Neuroshell 2, Ward Systems, Frederick, MD) , 
and for confidence interval analyses (CIA, British 

15 Medical Journal, London, UK) . A logarithmic 

transformation of AHI was used for both the ANN and the 
multiple linear regression in order to achieve a normal 
distribution of residuals. 

The variables used as inputs for the ANN were 

20 selected from the list of items obtained from the 
patient's questionnaire and from anthropomorphic 
measurements. The classification and regression tree 
was used to choose those variables more likely to 
influence the predictive properties of the ANN. Because 

25 logistic regression models sometimes perform better than 
a decision tree, a logistic regression was also 
performed to identify predictor variables. The 
- independent variables were scaled to a value over a 
range between -1 and 1. The responses to the Likert 

30 scale values were spaced equally at intervals of 0.5 

over this range. . Missing values and responses marked as 
"not applicable" were substituted with the class mean. 
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In the next step 58 of the method, the 
relationships determined in the prior step are expressed 
mathematically. The ANN described in this study was 
based on three layers: an input layer with 12 nodes, an 
5 output layer with a linear function and a hidden layer. 
The hidden layer consisted of a direct connection 
between the input and the output layers, and two groups 
of 21 nodes with differing activation functions. The 
activation function describes the nature of the linkage 

10 between the input layer and the hidden layer. A 
Gaussian function was used for one group and a 
hyperboric function' (tanh) for the other. Connections 
and outputs from the two groups in the hidden layer were 
linked to the output layer by linear functions . Each 

15 link was assigned a coefficient or weights that was 

updated during the learning process. The weights are 
assigned initially at random between -0.6 and +0.6. 

In the next step 60, the mathematically expressed 
relationships are exposed to a training set during which 

20 the mathematical relationships are presented with a set 
of input and output patterns. During this training 
phase, the inputs are fed into the mathematical 
relationships and the corresponding outcome is computed. 
The difference between the actual and desired outcome is 

25 propagated backward. Adjustments to connection weights 
in the mathematical relationships are made to minimize 
the error between the output predicted by the 
mathematical relationships and the measured attribute, 
in this example, the AHI. During training, the 

30 mathematical relationships are tested at regular 

intervals to determine the prediction error on a subset 
of data (evaluation data set) that is not included in 
the training process. As training proceeds, the 
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prediction error on the evaluation data set decreases 
initially but then increases when overtraining occurs. 
The mathematical relationships that produce the smallest 
error are selected (step 62) for further analysis. 

5 In the present example, a tenfold cross validation 

approach was used for evaluation. The entire data set 
of 189 patients was divided with a random number 
generator into ten subsets. Nine out of the ten subsets 
was pooled and used for training. The data from the 

10 tenth subset was used as an evaluation set during 
training. The entire process was repeated nine 
additional times by rotating the subset- that was used as 
the evaluation set during training. The mean square 
error was computed for each of ten sets of mathematical 

15 relationships on the entire derivation data set. The 
mean square errors were averaged and the set of 
mathematical relationships that had a mean square error 
closest to the average was selected. 

A multiple linear regression was employed to 

20 develop a model of AHI score based on the same 
independent variables used in the chosen set of 
mathematical relationships. Interaction terms were not 
included to determine the extent to which 
non-linearities and interaction terms contributed to the 

25 predictive accuracy of the chosen set of mathematical 
relationships. 

In the next step 64 of the method, the predictive 
model embodied by the chosen set of mathematical 
relationships is tested on an entirely different set of 

30 patients (validation cohort) that were not included in 
the derivation set. The validation cohort used to 
develop the above described ANN comprised all patients 
who underwent a sleep study between September 1996 and 
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December 1996. Patients were excluded from the study if 
they had been previously treated for sleep apnea, 
referred for a specific sleep disorder other than sleep 
apnea, or they failed to complete the sleep study. 
5 Then, a receiver operator characteristic (ROC) curve 

was generated for the chosen set of mathematical 
relationships. The ROC curve represents a graphic 
display of the true positives (sensitivity) plotted 
against the false positives (1-specif icity) for various 

10 thresholds that are used to define sleep apnea. The 

c-index was used to estimate diagnostic accuracy. The 
c-index is equivalent to the area under the ROC curve. 
In brief, it is calculated by determining the probability 
of diagnosing sleep apnea correctly in every possible 

15 pair of patients: one who has sleep apnea, the other who 
does not. A bootstrap method was used to calculate 
directly this measure of accuracy by generating 1000 data 
sets from a database by random sampling with replacement. 
Comparisons between the c-index for both models were 

20 assessed based on the confidence intervals. Statistical 
significance was accepted at the 5% level. 

To determine the predictive performance of the ANN, 
the relation between the actual and predictive values of 
the AHI were compared by linear regression. The point 

25 wise 95% confidence limits of that linear regression were 
used to establish the confidence interval of the 
predicted AHI. Comparison between the predictive 
accuracy of the ANN and multiple linear regression was 
made with correlation coefficients. The actual values of 

30 AHI were correlated with the predicted values. The 

correlation coefficient for the ANN was compared with the 
correlation coefficient obtained by multiple linear 
regression. 
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The results of the above described method and the 
predictive ability of the ANN are described below, and 
the description which follows further illustrates the 
methods described above. Between November 1995 and 

5 December 1996 , 289 sleep studies were performed at the 
Sleep Center. Twenty were excluded from further 
analysis: 12 patents were already diagnosed with sleep 
apnea, 6 patients were referred for a evaluation of sleep 
disorder other than sleep apnea, and 2 patients did not 

10 complete the sleep study. The derivation cohort was 
comprised of 189 patients, 66% males and 34% females. 
There were no significant differences in age, gender 
ratio, body mass index or neck circumference of patients 
of the derivation data set compared with the validation 

15 data set as, shown in Fig. 3. 

Even accounting for the greater number of men than 
women in the cohort, there was a predominance of sleep 
apnea among males (Chi-square Yates corrected p = 0.022). 
The age ranged from 14 to 95 years^with a mean of 48.1 

20 ±12.1 for those with sleep apnea, and 47.0 ±14.8 for 
those without sleep apnea (p=0.2), shown in 
Fig. 3. Fifty eight (31%) were found to be non-apneic 
(AHI 0-10), 23 (12%) to have mild obstructive sleep apnea 
(AM 11-20), 28 (15%) to have moderate sleep apnea (AHI 

25 21-40), and 80 (42%) to have severe sleep apnea (AHI>40) . 
Patients with sleep apnea were significantly more obese 
(p<0.01) and had a larger neck circumference (p<0.01) 
than their non-apneic counterparts (see Fig. 4). The 
validation cohort consisted of 80 patients; 54 males 

30 (68%) and 26 (32%) females. Eighty one percent of 
respondents had no missing data. The number of 
respondents missing one, two, three, or four apnea 
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symptoms items were 32 (13%), 12 (6%), 2 (0.7%), and 1 
(0.3%) respectively. 

Nine of 19 independent variables were selected in 
the final construction of the classification and 
5 regression tree. Six of the 19 independent variables of 
the logistic regression had coefficients that were 
statistically significant. Three of the six were not 
present in the classification and regression tree. 
Therefore, 12 variables were used as inputs to the ANN: 

10 nine from the classification and regression tree, and 

three additional variables from the logistic regression 
analysis. The questions to" which responses were deemed 
to have significant predictive power for sleep apnea by 
the classification and regression tree and by logistic 

15 regresision analysis are listed in Fig 5. Body mass 

index, neck circumference, and episodes of apneic events 
during sleep were the only parameters common to both 
analyses . 

The average of the mean square error of the ten ANNs 
20 performed was 0.089 (range 0.174-0.023). The ANN selected 
and described above had a mean square error of 0.092. The 
correlation coefficient from the ANN's predicted values 
of AHI and the actual values in the derivation set was 
0.856. The corresponding correlation coefficient for the 
25 multiple linear regression with the same predictor 

variables was 0.509. This value was significantly less 
than the correlation coefficient obtained with the ANN 
(p<0.01) . 

The performance of the ANN using a dichotomous 
30 definition of OSA is shown in Fig. 6 for the derivation 
data set as ROC curves. The c-index which is equivalent 
to the area under the ROC curve, was 0.94 6 ±0.0151 SE, 
0.948 ±0.0149 SE, and 0.944 ±0.0159 SE when OSA is 
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defined as an AH I of >10, >15 and >20/hour respectively. 
There were no statistically significant differences 
between these c-indices. Similarly, the performance of 
the ANN using a dichotomous definition of OSA is shown in 
5 Fig. 7 for the validation data set as ROC curves. The 
c-index was 0.96 ±0.0191 SE, 0.951 ±0.0203 SE, and 0.935 
±0.0274 SE when OSA is defined as an AH I of >10, >15 and 
>20/hour respectively. There were no statistically 
significant differences between these c-indices or with 
10 the corresponding c-indices obtained with the derivation 
data set. . 

Fig. 8 shows the relation between the predicted and 
actual values of AHI for the patients in the validation 
data set together with the point wise 95% confidence 

15 limits. Only one of the 80 values (1.25% 95%CI : 0-6. 7%) 
fell outside of the 95% confidence limits. 

As will be recognized by one skilled in the art, the 
present invention is a method, in the form of an ANN, 
which takes into account nonlinear relationships and 

20 intricate interrelationships among attributes of a 

complex process. The present inventions also presents a 
method for developing an ANN which results in a 
prediction having more specificity and fewer dichotomous 
outputs than prior art prediction, rules developed through 

25 regression analysis modes. It is therefore apparent that 
the present invention accomplishes the intended objects 
described above. Although embodiments of the present 
invention have been described in detail herein, the 
present invention is not limited to such embodiments and 

30 is limited by the appended claims. 
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Appendix A 



Source code fig sleep prg 



Note - the following are names of inputs 



* Note - x(l 

* Note - x(2 

* Note - x(3 

* Note - x{4 

* Note - x{5 

* Note - x(6 

* Note - x(7 

* Note - x(8 

* Note - x(9 



is AGE1 
is HT in 
is NCI CBC 
is BIB 
is EOS 
is OB? 
is SNOBS 
is STOPS 
is MGB 

* Note - x(10) is TQA 

* Note - r(ll) is BLS 

* Note - x(12) is LIBIDO 

* Note - outp(l) is LOGHDI 

* Note - r(13) is HT lbs - 
declare x[13] 

for a ■ 1 to 13 

x[m] - 0.0 

next m 

hti - 0 

htc - 0 

wtp - 0 

wtk - 0 

nci - 0 

nee - 0 

done - 1 

do while donetO 

e 1,1 say ' NEURAL NETWORK FOR PREDICTION OF RESPIRATORY 
DISTURBANCE INDEX (RDIJ ' 

8 2,1 say * Copyright B. J.B. Grant and A.A. El-Solh. Patents 

applied for. ' 

8 4,1 say • AGE: ' get x[l] picture '99.9" 
8 4,20 say ' HEIGHT: 1 get hti picture "999.9" 
8 4,35 say ' inches or ■ get htc picture ?999. 9" 
8 4,52 say Items' 

8 5,1 say ♦.HEIGHT:', get wtp picture «!999.9" 

8 5,15 say ? lbs or~» 

8 5,23 get wtk picture "999-9" 

8 5,29 say •kg ' 

8 5,32 say p HECK CXBCOMFEREHCE * get nci picture "999.99" 
8 5,60 say 'inches or* get nee picture "999.9" 
e 5,76 say •cm • 
ans4 - 'V 

8 7,1 say * Bave you been told or been treated for high blood pressure 

(Y/N) ?• get ans4 picture "Y" 

read 

if nci -0.0 
x[3] • nee 



x[3] - nci*2.54 



if wtp -0.0 
x[13] - wtk*2.2 
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x[13] - wtp 

t4 * 



if hrc - 0.0 
x[2] - hti 



x[2] - htc/2.54 



done - 0 

if x[2]« 0.0 .or 
done * 1 
?" Error: data 
wait 



x[3}« 0.0 .or. x[ll- 0.0 
must be entered for age, height and weight 



enddo 

if ans4 - 9 Y f 
x[4] - 1.0 
else 

x[4]. - 0.0 



3. Somewhat Agree (Sometimes 1-2 times /week) ' 

4. Agree Frequently (3-4 times per week) ' 

5. Strongly Agree (Always or Almost Always 5-7 



6 9,1 say * The following questions should be answered according to 
the following scale. 9 

8 10,1 say " 0. Not Sure, Don't Know or Not Applicable" 

8 11,1 say • 1. Strongly Disagree: Never 9 

8 12,1 say ' 2. Disagree (Rarely has occurred but less than 

once/week) 
8 13,1 say 
8 14,1 say 
8 15,1 say 
times /week) ' 
for si « 5 to 13 
x[m] - 0 
next m 

8 16, 1 say ■ I am very sleepy during the daytime and struggle to stay 
awake." get x [5] picture "9" range 0,5 

8 17,1 say " At night, my sleep disturbs your bed partner's sleep" get 
x[6] picture "9" range 0,S 

8 18,1 say * X am told I snore in my sleep. 9 get x[7] picture "9" - 
range 0,5 

8 19,1 say 9 I am told I stop breathing in my sleep. * get x[8] picture 
"9" range 0,5 

6 20,1 say v I suddenly wake up gasping for breath during the. night. 9 
get x[91 picture "9" range 0,5 

8 21,1 say 9 I feel tired upon awakening and want to go back to sleep. 
• get x[10] picture - 9" range 0,5 

8 22,1 say * I have or have been told that I have restless legs? ' get 
x[llj picture *9* range 0,5 

8 23,1 say ' My desire or interest in sex is less than it used to be? v 
get x[12] picture •9" range 0,5 



set echo off 

♦set device to file newx 
set device to print 
set printer to newx 
set printer on 

* converts to zero to one scale 
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f or m - S to 12 
If x[m] - 0 
x[m] - 0.5 
else 

x[»J - (x[m] - 1.0)*0.25 
next m 

set console off 

?str (xtU )+ f , f +str (xt21 g ^str(x[31)+ f , t +str(x[4J)+ f r •+str(x[51 )+•,•+ 

str(xt6])+ , # , +str{x[7])+^ t +str(x[8])+\ , +stx(xC91)+ , # •+str(x{10] ) + •, 

str (x [ 11] } * • , • +str (x [12 ] ) * • , ' +str (x [13] ) 

set console on 

set printer off 

set device to screen 

Isleepnet 

cancel 
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Source code for sleepnetibr 



Program Sleepnet 



dimension feat2C21), £eat3(21),outtp(3),rinp(12) , x{13) 

DIMENSION XNC12) ,XMC12) ,XMEAH{12) ,XSD{12) 

OPEN (erSTLE-'HEHX.BBS'rSXaiOS-'OLD') 

READ ( 6, * ) (X (I ) , 13} 
C COHVERT FROM IBS TO M 

X(2) - X (20*2.54/100.0 
C CONVERT FROM LBS TO KG 

XU3) - XC13J/2.2 
C CALCULATE BMT IN KG/M~2 

X(2) - X(13)/(X(2))**2 

OPEN (S,FIl£- , HEW^SD.D»I , ,STA^OS- , OtD , ) 

DO 20 I - 1,12 
. R£AD(S,*)XN(I}rXM(I),XMEJW{I},XSD{I) 
20 CONTINUE 

DO 30 I - 1,12 
C COT OFF OVER LIMITS 

if {X(I).GT.XM(I})XCI)-XM(I) 
if (X(I).LT.XH(I))X(I)-XH{I> 

C SCALE 0 TO 1' 

B - 1.0/(XM(IJ ~ XN(I)) 

C - -B*XN(I) 



X(I) - X(I)*B + C 



30 CONTINUE 


c Note 


- the following ; 


c Note 




inp(l) is AGE1 


c Note 




inp(2) is BMX1 


c Note 




inp(3) is NCI 


c Note 




inp(4) is HTN 


c Note 




inp(5) is EDS 


c Note 




inp(6) is DBP 


c Note 




inp(7) is SNORE 


c Note 




iap(8) is STOPS 


■c Note 




inp(9J is WGB 


e Note 




inp{10) is TOA 



are names of inputs and outputs 
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e Note - lap (11) is RLS 
c Note - inp(12) is LIBIDO 

do 90 i-1,12 
rinp(i) * x(i) 
90 continue 



4£ 


Ixxap I 


n i if 


plvm ( 11 

XXQO I X I 




U 




4 # 

XX 


t r*4 nn 


H 1 fvf 1 A 
LX/ v^w* X J 


x *T*p t x J 




X 




ri 


JQp(l) 


• 2 * rinj 


?(i) -l. 








xx 


ixxxip i 


f2l It 01 

k X / • Xb> • W J 


rim f 21 




u 




if 






rinn(2) 




1 




ri 


Jip(2) 


- 2 * rinj 


?(2) -1 








XX 


i ri nn i 


r^i it oi 

i J / tit • V J 






n 
u 




* * 

XX 


/ t»4 nn I 




rinn J31 








ri 


Jip(3) 


« 2 ♦ rinj 


?(3) -1 










f nn i 


> t» / • xt. * u / 










4 * 


(imp i 


r 4 \ — i i 
I • g u • x j 


x xup \ 7 




X 




ri 


■ap(4). 


« 2 * rin] 


?<4) -1 








if 


(rinp 1 


r5i it oi 


xxu^j iwj 




n 

V 




if 


(rinol 


p 51 at 11 


rinn f 5 1 




X 




ri 


•np (5) 


» 2 * rin] 


?(5) -1 








if 


Crinpl 


rgi it 01 


rinp (6) 




o 




if 


(rinpl 


'£1 rrt 11 


rinp<6) 




X 




ri 


Jip(6) 


- 2 * rinj 


?(6) -1 








if 


(rinpl 


r7i it oi 


rinp (7) 




0 




if 


(rinpl 


r 71 tit 11 


rinp (7) 




X 




ri 


*pC7) 


- 2 * rin] 


?(7) -1 








if 


(rinpl 


rfli it 01 


rinp (8) 




0 




if 


(rinpl 


r fl1 at 11 


rinp (8) 




X 




ri 


■np(B) 


» 2 * rim 

mm 


?(8) -1 








if (rinpi 


[9) .lt.0) 


rinp (9) 




0 




if 


(rinpl 


[9).gt.l) . 


rinp (9) 




1 




ri 


JJP(9) 


- 2 * rinj 


?(9) -1 








if 


(rinpl 


(lO).lt.O) 


rinp (10) 




0 


if 


(rinpl 


(lO).gt.l) 


rinp (10) 




1 


ri 


.np(10] 


1 - 2 • ri] 


op (10) - 


•1 






if 


(rinp 


tlD.lt.0) 


rinp (11) 




0 


if 


(rinp 


(ll).gt.l) 


rinp (11) 




1 


ri 


jipdi] 


1 - 2 * rii 

• 


BP (11) - 


•1 






if 


(rinp 


(12).lt.O) 


rinp (12) 




0 


if 


(rinp 


(12).gt.l) 


rinp (12) 




1 


rinp(12] 


1 - 2 * ri 


op (12) - 


•1 







netsrai - -1.281773 

netsum - netsum + rinp(l) * (-0.7484438) 
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netsum - netsum + riap(2) 

(3) 
(4) 
(5) 
(6) 
(7) 
(8) 

(9) 
(10) 

Cll) 



+ 

netsum + 
netsum + 
netsum + 
+ 
+ 
+ 



netsum - netsum + rinp(12) 



0.1946502 
(-0.5387345) 
(-0.2521914) 
(-1.296348) 
0.4516059 
(-0.5284248) 
(-0.9564578) 
(-0.6124287) 
0.3784178 
0.2143384 
0.4457278 



feat2{l) - exp (-netsum * netsum) 



netsum - -.1579302 
netsum -netsum + rlnp 



netsum -netsum 
netsum -netsum 
netsum -netsum 
netsum -netsum 
netsum -netsum 
netsum —netsum 
netsum —netsum 
netsum —netsum 



+ rinp(l) 
+ rinp(2) 
+ rinp(3) 
+ rinp(4) 
+ rinp(5) 
+ rinp(6) 
+ rinp(7) 
+ rinp(8) 
+ rinp(9) 
+ rinp(lO) 
+ rinp(ll) 
+ rinp(12) 



feat2(2) - ex? (-netsum 



(-0.6913328) 
0.3625014 

(-0.9706698) 

(-0.1501043) 
0.4243536 
3.680062E-02 
1.378896E-02 
0.3586607 

(-8.128129E-02) 

* 0.4440929 

* (-0.2487337) 

* (-0.6973214) 
netsum) 



netsum - 17.0492 
netsum -netsum + 
netsum -netsum + 
netsum -netsum + 
netsum -netsum + 
netsum -netsum + 

+ 
+ 
+ 
+ 

netsum -netsum + 
netsum —netsum + 
netsum -netsum + rlnp 



netsum -netsum 
netsum -netsum 



(1) * 16.82284 

(2) * 0.8428642 

(3) * 2.572662 

(4) * 0.7950218 

(5) * (-2.513585) 

(6) * 0.9777063 

(7) * (-2.577032) 

(8) * (-0.1786035) 

(9) * (-0.2378135) 

(10) * 0.3698948 

(11) ♦ (-0.1214744) 

(12) * 0.7108723 



feat2(3) - exp (-netsum * netsum) 



netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
feat2 



—9.469316 
-netsum + rinp(l) * 
-netsum + rinp(2) * 
-netsum + rinp{3) * 
-netsum + rinp(4) * 
-netsum + rinp(5) * 
-netsum ♦ rinp(6) ♦* 
-netsum + rinp(7) * 
-netsum + rinp(8) * 
-netsum + rlnp (9) * 
-netsum + rinp(10) * 
-netsum + rinp(ll) * 
-netsum + rlnp (12) * 



(-10.42911) 
(-0.1438574) 
(-0.5054889) 
(-0.2067168) 
0.6667147 
(-0.4913783) 
(-0.1237129) 
0.8214485 
0.2972933 
0.5863733 
1.099139 
0.8866732 



(4) - exp (-netsum * netsum) 
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netsun —7.332463 



♦ rinpd) 
+ rinp(2) 
+ rinp(3) 
+ rinp(4) 

♦ rinp(S) 
+ rinp{6) 
+ rinp(7) 
+ rinp(8) 
•i- rinpO) 

♦ rinp(lO) 
+ rinp(ll) 
+ rinp(12) 

feat2(5) - exp (-netsua * 



' (-7.581017) 
' (-1.661227) 
' 0.6603476 

• (-2.950335) 
' 1.931185 

' 1.572326 
' 1.951563 

• 2.154931 

' 0.4884028 

* 1.935233 

♦ 1.277721 

♦ 3.075218 
netsum) 



netsua ~ .481048 
netsua -netsum + 
netsua —netsua + 
netsua -netsum + 
netsua -netsua +• 
netsua -netsua +■ 
netsua —netsua + 
netsua —netsua + 
netsua —netsua + 
netsua -netsua +• 
netsua —netsua + 
netsua -netsua + 
netsua -netsua + 
feat2{6) - exp(- 

netsua — 1.753536 
netsua -netsua + rinp 
netsua —netsua + 
netsua -netsua +■ 
netsua -netsua +■ 

+ 

+ 
+ 
♦ 
+ 

exp(- 



(1) * .5431959 

(2) * (-0.830407) 

(3) * 2.972075 

(4) * .8866829 

(5) * .9294431 

(6) * 9-. 9728751 

(7) * .4534347 

(8) * 5.592725E-02 

(9) * (-2.779128E-02) 

(10) * 2.803787 

(11) * .8311194 

(12) * (-0.4631482) 
netsua * netsua) 



netsua -netsua + rinp 



(1 
(2 
(3 
(4 
(5 
(6] 

(7: 

(8 

o: 

(10) 

(11) 

(12) 



£eat2(7) - 



netsua - 22.32288 
netsua —netsua + 
netsua -netsua + 

+ 
+ 

netsua —netsua + 
netsua -netsum + 
netsua -netsua + 
netsua —netsua + 

+• 
♦ 



(1) 
(2) 
(3) 
(4) 
(S) 
(6) 
(7) 
(8) 
(9) 
(10) 



2.018607 

4.511654 
(-6.671103) 
(-0.3334266) 

.4577192 
(-2.088647) 
(-5.33801) 
(-1.461806) 

2.104948 

* (-0.7131135) 

* .6349583 

* (-0.9221169) 
netsua) 



21.96984 

1.645584 
(-0.5201622) 

14.70671 

.5982078 
(-0.6221699) 
(-0.271651) 
(-3.716928E-02) 
(-0.2856258) 
.4259164 
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+ rinp(ll) * 1.521184 
+ rinp(12) * 1.781551 
£eat2(8) ~ e3cp(-netsum * netsum) 



netsum -18.37576 



netsum 
feat2(9) 



+ 
+ 
+ 
+ 
♦ 
+ 
+ 
+ 
+ 
+ 

(- 



(1) 

(2) 
(3) 

(4) 

(5) 

(6) 

(7) 
(8) 

(9) 
(10) 

(11) 
(12) 



' 18.11695 
' 2.03335 
' 7.33104 
' .3977718 
' .1416061 
' (-0.3049832) 

* (-3.765624 } 
' (-1.304008 } 
r (-9.033795 J 
♦(-3.40293 ) 

* (-0.1483207) 

* .6851714 
nets am} 



netsum - .8604497 
netsum —netsum + 
netsum -netsum + xinp 
netsum —netsum + 
netsum —netsum + 

+ 
+ 
♦ 
+ 
+ 
+ 
+ 
+ 

exp(- 



netsum 
netsum 



netsum 
netsum - 
netsum 
feat2(10) 



(1) 
(2) 
(3) 
(4) 
(5) 
(6) 
(7) 
(8) 

(9) 
(10) 

(11) 
(12) 



.1640067 

3.126678 
(-0.3303308) 
(-0.2181669) 
(-0.8808434) 
(-0.7185585) 
(-0.2771405) 

.229917 

8.204659E-02 
(-1.250545 ) 
(-0.6641473) 

' 5.099313E-02 

netsum) 



netsum -netsum 
netsum -netsum 



netsum - 9.731671E-03 
netsum -netsum + rinp(l) 

+ rinp(2) 
+ rinp(3) 
+ rinp(4) 
+ rinp(5) 
+ rinp (6). 
+ rinp(7) 
+ xinp (8) 
+ rinp(9) 
+ rinp(lO) 
+ rinp(ll) 
netsum -netsum + rinp (12) 



netsum -netsum 



.5964558 

1.320623 
(-0.4427402) 
(-0.2039201) 

.7026184 

1.133914 

.1080545 

1.638826 

9.78912BE-02 
.9474844 
2.16437 

(-0.7597708) 



feat2(ll) - exp (-netsum * netsum) 



netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 



-21.7906 

+ rinp(l) 

+ rinp (2) 

+ rinp (3) 

-netsum + rinp (4) 

-netsum + rinp (5) 

-netsum + rinp (6) 

-netsum + rinp (7) 



1-22. 28039) 
(-1.04849 ) 
3.056987 
(-.316791 
1.355303 
3.271367 
9 . 923672 



) 
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netsum —netsum + rij 


ap(8) 


* 4.104192 


netsum -netsum + rii 


ap(9) 


* .4940526 


netsum —netsum + rii 


ap(10) 


* .6994582 


netsum «netsum + rii 


ip(ll) 


* {-2.14997 } 


netsum -netsum + rii 


ap(12) 


♦ (-.4787159 ) 


feat2(12) - cxp{-ni 


etsum 


* netsum) 


netsum - 14.5285 






netsum —netsum + rij 


ip(l) 


* 14.09845 


netsum —netsum + rij 


ID (2) 


* 1.341903 


netsum —netsum + rij 


ip(3) 


* (-2.476427) 


netsum —netsum + rij 


ip(4) 


* (-0.281077) 


netsum -netsum + rii 


ip(5) 


* (-0.1991969) 


netsum -netsum + rii 


3p(6) 


* (-.3404187) 


netsum -netsum + rij 


9(7) 


* (-1.639992) 


netsum —netsum + rii 


9(8) 


* (-5.519081) 


netsum -netsum + rii 


3p(9) 


* (-4.471209E-02) 


netsum -netsum + rii 


3S(10) 


* 1.709916 


netsum -netsum + rii 
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CLAIMS : 

What is claimed is: 
■ 1. A method for predicting respiratory disturbances 
comprising: 

5 gathering information from a patient, the 

information comprising pieces of information answers to 
questions and responses to statements; 

determining numerical values for each of the answers 
and responses; 

10 determining a first set of predictive indicators 

from the pieces of information; 

determining a second set of predictive indicators 
from the pieces of information; 

determining a predictive number from the pieces of 
15 information, the first set of predictive indicators, and 
the second set of predictive indicators, wherein the 
predictive number corresponds to a respiratory 
disturbance index; and 

providing the predictive number to a health 
20 professional. 

2. A storage device having stored thereon computer 
readable code for causing a computer to execute the 
method of claim 1. 

25 

3. A method for developing an artificial neural network 
for making a prediction about an attribute comprising: 

determining relevant information needed to make a 
predication; 

30 performing clinical studies on patients to determine 

which patients have a particular attribute and to produce 
results corresponding to the attribute; 
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gathering information about the patients, the 
information comprising pieces of information; 

statistically analyzing the information gathered to 
determine relationships between the pieces of information 
5 and the results from the clinical studies; 

expressing the relationships mathematically; 

exposing the mathematical relationships to a 
training set and adjusting the mathematical relationships 
to produce" a desired outcome; and 
10 testing the adjusted mathematical relationships. 
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10 



GATHER ANSWERS AND 
RESPONSES FROM 
THE PATIENT 



12 



\ 



DETERMINE NUMERICAL VALUES 
FOR EACH OF THE ANSWERS 
AND THE RESPONSES 



14 




CALCULATE THE BMI 
BMI=X(13)/(X(2))2 



16 



1 



22 



DETERMINE FIRST PREDICTIVE 
NUMBER(OUTPUT) FROM THE 
REVISED INPUT VALUES(RINP),THE 
FIRST SET OF PREDICTIVE INDICATORS 
FEAT(2),AND THE SECOND SET OF 
PREDICTIVE IND1CATQRS(FEAT3) 



DETERMINE THE REVISED 
INPUT VALUES RINP, 
FROM THE NUMERICAL VALUES 



18 



DETERMINE THE FIRST 
SET OF PREDICTIVE 
INDICATORS(FEAT 2) FROM 
THE REVISED INPUT VALUES 



20 




DETERMINE THE SECOND 

SET OF PREDICTIVE 
INDICATORS(FEAT 3) FROM 
THE REVISED I NPUT VALUES 

1 



24 



DETERMINE SECOND PREDICTIVE 
NUMBER(a1 ) FROM THE FIRST 
PREDICTIVE NUMBER(OUTPUT) 


1 


. r 



PROVIDE THE SECOND 
PREDICTIVE NUMBER(a1 ) TO 
HEALTH PROFESSIONAL 



FIG.1 
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DETERMINE RELEVANT INFORMATION 
NEEDED TO MAKE THE PREDICTION 



-50 



PERFORM CLINICAL STUDIES TO DETERMINE 
WHICH PATIENTS HAVE A PARTICULAR ATTRIBUTE 



52 



GATHER ANSWERS AND RESPONSES 
FROM THE PATIENTS STUDIED 



54 



STATISTICALLY ANALYZE THE ANSWERS AND 
RESPONSES TO DETERMINE RELATIONSHIPS 



56 




EXPRESS THE RELATIONSHIPS 
MATHEMATICALLY 



58 




EXPOSE THE MATHEMATICAL RELATIONSHIPS 
TO A TRAINING SET AND ADJUST 
THE MATHEMATICAL RELATIONSHIPS 




60 




SELECT THE SET OF MATHEMATICAL RELATIONSHIPS 
WHICH PRODUCES THE SMALLEST ERROR 



62 




TEST THE SELECTED SET OF 
MATHEMATICAL RELATIONSHIPS 



64 



FIG. 2 
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CART VARIABLES 



1 . RESPONSE TO "I AM TOLD I STOP BREATHING IN MY SLEEP." 

2 RESPONSE TO "I FEEL TIRED UPON AWAKENING AND WANT TO GO 

BACK TO SLEEP." 

3. RESPONSE TO "MY DESIRE OR INTEREST IN SEX IS LESS THAN IT 

USED TO BE." 

4. RESPONSE TO "AT NIGHT, MY SLEEP DISTURBS MY BED PARTNER'S 
SLEEPck" 

5. RESPONSE TO "I AM VERY SLEEPY DURING THE DAYTIME AND 
STRUGGLE TO STAY AWAKE." 

6 RESPONSE TO "I HAVE OR HAVE BEEN TOLD THAT I HAVE RESTLESS 

LEGS." 

7. BODY MASS INDEX. 

8. NECK CIRCUMFERENCE. 

9. AGE 

LOGISTIC REGRESSION VARIABLES 

1. RESPONSE TO "I AM TOLD I STOP BREATHING IN MY SLEEP." 

2 RESPONSE TO "I SUDDENLY AWAKE GASPING FOR BREATH DURING 
THE NIGHT." 

3. RESPONSE TO "I AM TOLD I SNORE IN MY SLEEP." 
4 RESPONSE TO "DO YOU HAVE OR ARE YOU BEING TREATED FOR HIGH 
BLOOD PRESSURE?" 

5. BODY MASS INDEX. 

6. NECK CIRCUMFERENCE. 

VARIABLES NOT SELECTED 

1 RESPONSE TO "FALLING ASLEEP WHILE ENGAGED IN AN ACTIVITY." 

2. RESPONSE TO "FALLING ASLEEP WHILE IN A QUIET, PASSIVE, OR 
RELAXING SITUATION." 

3. RESPONSE TO "I HAVE HAD ACCIDENTS OR NEAR ACCIDENTS WHILE 
OPERATING A MOTOR VEHICLE." 

4 RESPONSE TO "I HAVE DIFFICULTY FALLING ASLEEP." 

5 RESPONSE TO "WHEN I AWAKEN DURING THE NIGHT. I HAVE 
DIFFICULTY FALLING BACK TO SLEEP." 

6. GENDER 

7. AMOUNT OF ALCOHOL INGESTION. 



FIG. 5 
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FIG.6 
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1-SPECIFICITY 



FIG. 7 
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LOG 1 0[PREDICTED AH I +1] 



FIG.8 



